SYSTEMS AND METHODS FOR GENERATING AND DISTRIBUTING 
EXECUTABLE PROCEDURES FOR TECHNICAL DESK-SIDE SUPPORT 

Technical Field 

The invention generally relates to systems and methods 
for generating and disseminating computer-executable 
procedures for providing technical support. More 
specifically, the invention relates to systems and methods 
for dynamically generating computer executable technical 
support procedures, as well as updating/augmenting such 
executable procedures, by tracking and processing sequences 
of actions (execution traces) that are taken by experts (or 
users) when performing a procedure or when executing an 
executable procedure. 

Background 

Currently, technical support is provided either in- 
person or remotely, whereby individual problems are 
addressed by technical support staff. When the same 
problems or similar problems are encountered, the same 
solution procedures or similar solution procedures are 
repeatedly executed to solve such problems. 

When a procedure needs to be executed on a large number 
of machines, e.g., to upgrade portions of the operating 
system on all machines belonging to an organization, it is 
customary to script the procedure (i.e., build a program in 
an appropriate high-level language that executes the 
procedure) . The process of building such scripts, however, 
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is extremely expensive in terms of costs associated with 
design, development and testing, although the costs 
associated with design and development time are usually 
negligible as compared to the costs associated with test 
5 time. 

In contrast to regular end-user applications that are 
easily portable across different versions of the same 
operating system and across different configurations of the 
same operating system, maintenance and upgrade procedures 

10 often modify inner layers or parameters of the operating 

systems. Therefore, maintenance and upgrade procedures must 
be tested on a wide variety of operating system versions and 
configurations. This requires a substantial time investment 
as well as a large, well-equipped testing facility. 

15 Due to the costs associated with scripting procedures, 

other methods may be used for enabling maintenance or 
upgrades. For instance, one method is to produce a document 
having instructions that guide a user through the necessary 
maintenance and upgrade steps. However, much like general 

20 software documentation, these instructions are often 

difficult to follow. For example, the instructions may read 
"if you have version XX of the operating system, go to step 
5, otherwise go to step 3. To determine which version of the 
operating system your machine is running go to step 13." 

25 This instruction can be confusing even for an expert user, 
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and does not cover all possible situations. Therefore, the 
alternate solution using instructive documents has a hidden 
cost in that users for whom the documentation is too 
difficult or incomplete to understand are forced to call a 
support center and must be assisted on an individual basis. 

Other disadvantages associated with conventional 
methods that use scripted procedures or documentation is 
that such methods suffer from obsolescence. For example, as 
newer versions of operating systems, applications, and 
hardware components become available, scripted procedures 
must be updated to accommodate the newer versions and such 
updates are often very costly. Similarly, instructive 
documentation must be appropriately revised by adding new 
sections and such revisions only render such documents more 
confusing for end-users. 

A need therefore exists for improved systems and 
methods for generating and disseminating technical support 
procedures that enable maintenance and upgrades of various 
systems, which overcome the problems associated with 
conventional methods. 

Summary of the Invention 

The present invention is directed to systems and 
methods for generating and disseminating computer-executable 
procedures for providing technical support. More 
specifically, the invention is directed to systems and 
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methods for dynamically generating computer executable 
technical support procedures, as well as updating/augmenting 
such executable procedures, by tracking and processing 
sequences of actions (execution traces) that are taken by 
experts (or users) when performing a procedure or when 
executing an executable procedure. 

In one embodiment of the invention, a method for 
generating a reusable executable procedure comprises 
obtaining a plurality of execution traces, wherein each 
execution trace represents an execution instance of a 
procedure, and then processing the execution traces to 
create a reusable executable procedure that is associated 
with the procedure. 

Preferably, an execution trace is obtained by 
monitoring and recording a sequence of actions that are 
performed by an individual (e.g., expert) when executing an 
instance of the procedure. Further, one or more executed 
actions can be annotate to describe such actions. 

In another embodiment of the invention, the execution 
traces are processed by aligning the execution traces to 
identify corresponding steps between the execution traces, 
and then generalizing the aligned execution traces to 
generate the reusable executable procedure. A 
generalization process according to the invention comprises 
generalizing branches of procedures, generalizing iterations 
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of procedures, generalizing recovery from failure of 
procedures, or generalizing variables of procedures, for 
example . 

Preferably, reusable executable procedures are stored 
in a library of reusable executable procedures for 
distribution to a plurality of users. The reusable 
executable procedures can be executed in a client device 
(e.g., personal computer) for diagnosing hardware or 
software or upgrading software, for example. 

During execution of an executable procedure, at the 
user's option, or due to circumstances in which one or more 
steps of an executable procedure cannot be successfully 
executed, the user can control the procedure execution by 
manually performing one or more steps of the executable 
procedure. An execution trace representing the user's 
actions, for example, when manually performing such steps 
can then be processed to augment the reusable executable 
procedure . 

More specifically, in another embodiment of the 
invention, a method for executing a reusable procedure 
comprises launching a reusable executable procedure, 
automatically executing procedure steps associated with the 
reusable executable procedure, and relinquishing control of 
execution of the reusable procedure to a user, when a next 
step of the reusable executable procedure cannot be 
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successfully executed. In yet another embodiment, the method 
comprises monitoring user actions while the user is 
executing steps of the reusable executable procedure, 
aligning the monitored user actions to the reusable 
5 procedure, and continuing automatic execution of the 

reusable procedure, if the monitored steps align with the 
reusable procedure. The monitored user actions can be used 
to augment the reusable executable procedure. 

These and other embodiments, aspects, features and 
10 advantages of the present invention will be described or 
become apparent from the following detailed description of 
preferred embodiments, which is to be read in connection 
with the accompanying drawings. 

Brief Description of the Drawings 
15 Fig. 1 illustrates a method for generating and 

distributing executable procedures according to an 
embodiment of the present invention. 

Fig. 2 illustrates a system for generating and 
distributing executable procedures according to an 
20 embodiment of the invention. 

Fig. 3 illustrates a method for executing an executable 
procedure according to an embodiment of the invention. 

Fig. 4 illustrates a method for executing an executable 
procedure according to another embodiment of the invention. 

25 
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Detailed Description of Preferred Embodiments 

The present invention is directed to systems and 
methods for dynamically generating computer executable 
technical support procedures, as well as updating/augmenting 
5 such executable procedures, by tracking and processing 
sequences of actions (execution traces) that are taken by 
experts (or users) when performing a procedure or when 
executing an executable procedure. 

It is to be understood that the systems and methods 

10 described herein in accordance with the present invention 
may be implemented in various forms of hardware, software, 
firmware, special purpose processors, or a combination 
thereof. Preferably, the present invention is implemented in 
software as an application comprising program instructions 

15 that are tangibly embodied on one or more program storage 

devices (e.g., hard disk, magnetic floppy disk, RAM, CD ROM, 
DVD, ROM and flash memory) , and executable by any device or 
machine comprising suitable architecture. 

It is to be further understood that because the 

20 constituent system modules and method steps depicted in the 
accompanying Figures can be implemented in software, the 
actual connections between the system components (or the 
flow of the process steps) may differ depending upon the 
manner in which the application is programmed. Given the 

25 teachings herein, one of ordinary skill in the related art 
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will be able to contemplate these and similar 
implementations or configurations of the present invention. 

Referring now to Fig. 1, a flow diagram illustrates a 
method for generating and distributing a reusable executable 
5 procedure according to an embodiment of the invention. 

Initially, an expert executing a given procedure or task is 
"observed" (step 101) . More specifically, the process of 
observing comprises monitoring and recording a sequence of 
steps/actions (e.g., mouse clicks, keyboard actions, etc.) 

10 that are taken by an expert (or user) when manually 

performing a task/procedure on, e.g., a machine that is to 
be repaired or upgraded. Furthermore, while the expert 
executes the procedure, the expert may annotate one or more 
executed steps to explain why certain actions are taken or 

15 why certain decisions are made, and such annotations are 

recorded (step 102) . It is to be understood that steps 101 
and 102 can be executed in parallel and not necessarily in a 
sequential order. 

The captured sequence of actions and recorded 

20 annotations are then converted to an annotated execution 
trace that represents the execution of the procedure. The 
execution trace is then stored in a procedure database (step 
103) . Preferably, multiple execution traces corresponding 
to the same or similar procedure are generated and stored in 

25 the procedure database by different experts (or users) on 
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different machines, for example. Then, to produce an 
executable procedure for a given procedure, one or more 
corresponding/related procedure execution traces are 
retrieved from the procedure database (step 104) . 
5 The retrieved execution traces are aligned and 

generalized to produce an executable procedure. More 
specifically, an alignment process is performed on the 
procedure execution traces to identify/match 
corresponding/related steps/actions between the different 

10 procedure traces (step 105) . An alignment process according 
to an embodiment of the invention comprises identifying the 
control flow of the procedure by determining which steps in 
each trace correspond to the same logical step in the 
executable procedure. For example, if one procedure trace 

15 consists of two required steps with an optional step in 

between, and a second procedure trace contains only the two 
required steps, the alignment process determines that the 
first steps observed in both traces are instances of the 
same procedure step, and the last steps observed in both 

20 traces are instances of a second procedure step, and the 
optional step may be present in some executions of the 
procedure, but not others. 

A generalization process is performed using the aligned 
traces to produce a distributable executable procedure (step 

25 106) . A generalization process according to an embodiment 
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of the invention comprises identifying differences between 
corresponding steps of different traces, explaining them, 
and abstracting them into a logical description of the 
action to be performed at each step. Such differences may 
5 arise because of variances in the environments in which the 
traces were generated, such as the username of the expert 
performing the procedure, or the name of the computer on 
which the procedure is performed. 

Examples of a generalization process according to the 

10 invention will now be provided. Consider a scenario in which 
a communication device, e.g., a wireless card, is installed, 
and an operating system is instructed to use a specific 
domain name server ("DNS") . Traces acquired at different 
locations, such as, on computers having different domain 

15 names, have different DNSs. In this example, a 

generalization process according to the invention would be 
used for detecting these differences, correlating the 
differences with the domain name, and inferring a rule to 
generate the Internet protocol ("IP") address of the DNS 

20 from the domain name of the machine. 

Another example of generalization comprises identifying 
branch points in a procedure, where different sub-procedures 
are executed depending on values of system properties or of 
user characteristics. The generalization process identifies 
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relevant user properties or user characteristics that 
determine which sub-procedure is executed. 

Yet another example of generalization comprises 
identifying sequences of steps that are iteratively 
5 performed on a collection of objects. In a programming 
language, this corresponds to a loop. A generalization 
process according to the invention identifies a collection 
of objects on which to perform a sequence of steps, the 
potential differences between the sequences of steps 
10 performed on individual objects, and a terminating condition 
of the loop. 

It is to be understood that in another embodiment of 
the invention, the alignment and generalization steps can be 
combined into one step, rather than being separately 
15 executed. 

Once executable procedures are generated and stored, a 
desired procedure can be retrieved and executed (step 107) . 
In accordance with the invention, the process of retrieving 
a stored procedure can be performed in a variety of ways. 
20 For example, an executable procedure can be delivered to a 
user via e-mail or on electronic media (e.g., floppy 
diskette) . Furthermore, an executable procedure can be 
retrieved by a user using a file transfer protocol ("FTP") 
server, or an executable procedure could be retrieved from a 
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web-server where a search engine facilitates the 
identification of the correct procedure. 

Referring now to Fig. 2, a diagram illustrates a system 
for generating and disseminating executable procedures 
according to an embodiment of the invention. The system 
(200) comprises a user machine (201) (e.g., PC (personal 
computer, laptop computer, etc) comprising a procedure 
monitoring application (202) . The procedure monitoring 
application (202) is used to monitor and record procedures 
that are executed and annotated by either an expert or by a 
user under the direction of an expert during a phone 
consultation, for example, to create annotated procedure 
traces. The annotated procedure traces are sent over a 
network (203) (e.g., Internet, WAN, LAN, wireless, or 
combination thereof, etc.) to a remote system (204). In one 
embodiment, the procedure monitoring application (202) 
performs the steps 101-103 of Fig. 1. 

The remote system (204) comprises a procedure trace 
repository (205) or database which stores annotated 
procedure traces that are generated via application (202). 
A server (206) retrieves traces of similar procedure 
executions from the repository (205) and generates 
executable procedures via a procedure generation application 
(207). More specifically, in one embodiment, the procedure 
generation application (207) aligns and generalizes the 
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traces, and produces distributable executable procedures 
(steps 104-106, Fig. 1) which are stored in a database (209) 
of a procedure server (208) . The stored reusable, 
executable procedures (209) can then be distributed across 
5 the network (203) to one or more user machines (210) 

comprising a procedure execution engine (211) for executing 
such procedures. It is to be understood that the components 
of system (204) can be distributed over a network (e.g., 
network (203) ) . 

10 In a preferred embodiment of the present invention, a 

procedure monitoring application (202) comprises modules to 
interface with an operating system (e.g., a version of 
Microsoft Windows® operating system) to retrieve system 
information using published application program interfaces 

15 ("API") of the operating system, as well as modules that 

observe the actions of the user, such as mouse movements and 
keyboard clicks. Methods for monitoring mouse events and 
keyboard events are known in the art, and can be performed, 
for example, in the Microsoft Windows® operating system 

20 using appropriate system calls. For example, the APIs and 
system calls for Microsoft Windows® operating systems are 
described in publicly available documentation. 

Preferably, a procedure monitoring application (202) 
according to the present invention is capable of recording a 

25 wide variety of system actions, including visible changes to 
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a graphical user interface ("GUI"), such as, creation and 
deletion of windows, changes to window contents, and 
creation, deletion, activation, and deactivation of network 
connections, for example. 
5 It is to be appreciated that there are various 

advantages associated with the systems and methods according 
to the invention. For example, rather than repeatedly 
guiding multiple users through the same procedure, or 
writing a complex program (script) that corresponds to the 

10 procedure and testing the program on a variety of machines, 
the present invention enables support center personnel to 
guide a few users through the procedure, record the 
procedure execution traces, and then build an executable 
procedure from such traces. The executable procedure could 

15 then be deployed instead of a script. Accordingly, when a 
user needs to perform a required task, the corresponding 
executable procedure could be delivered to the user and 
automatically executed without further intervention of 
support personnel. 

20 It is to be understood that the number of execution 

traces that are needed to learn a given procedure will vary 
based on the complexity of the procedure. For example, a 
small number of execution traces would be required to learn 
procedures having limited variability, whereas a potentially 
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large number of traces would be required for complex 
procedures . 

There are various methods for executing executable 
procedures according to the invention. In general, in one 
5 embodiment, an execution method comprises automatically 
executing an entire executable procedure. In another 
embodiment of the invention, an execution method comprises 
automatically executing applicable portions of a procedure, 
wherein a user or an expert can execute portions of the 

10 procedure that have not been learned from previous examples 
(execution traces) . In yet another embodiment, an execution 
method comprises recording user actions performed during the 
execution of portions of the procedure that have not been 
learned from previous examples, and augmenting the procedure 

15 by processing the recorded actions. 

Fig. 3 is a flow diagram of a method for executing an 
executable procedure according to an embodiment of the 
invention. Fig. 3 illustrates a mode of operation of a 
procedure execution engine (211, Fig. 2) according to an 

20 embodiment of the invention. Initially, a user will 

obtain/select/retrieve an executable procedure using methods 
as described above, and the execution engine will commence 
execution of the selected procedure while monitoring system 
parameters, user actions and system reactions (step 300) . 

25 It is to be understood that such monitoring is preferably 
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performed using the same (or similar) procedure monitoring 
system and method as described above with respect to the 
procedure monitoring application (202) . 

Execution of the procedure will continue (i.e., the 
execution engine will continue to execute the procedure 
steps) until a termination condition is met (affirmative 
determination in step 301) in which case the execution 
engine terminates execution (step 307) . On the other hand, 
when a termination condition is not met (negative 
determination in step 301), the execution engine will 
attempt to determine the next procedure step to be executed 
(step 302) . 

If execution engine can determine the next step of the 
procedure that is to be performed (affirmative determination 
in step 302), the execution engine will attempt to 
generalize the action (s) associated with the current 
procedure step (step 303) . More specifically, the execution 
engine will attempt to tailor the action (s) to the specifics 
of the procedure instance being executed. If the action (s) 
can be generalized (affirmative determination is step 303), 
a determination is made as to whether user input is needed 
for executing the action(s) (step 304). 

If no user interaction is required (negative 
determination in step 304), the execution engine executes 
the action (s) (step 306), then process flow continues from 
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step 300. If user input (e.g., password) is required 
(affirmative determination in step 304), then the system 
asks the user for the desired input (step 305) (e.g., user 
is prompted for a password), and the action (s) are executed 
(step 306) . 

As depicted in the method of Fig. 3, if the currently 
available procedure is suitable for a specific configuration 
of the machine/device on which the procedure is executed, 
and no unforeseen error conditions occur, then the entire 
procedure is automatically executed until successful 
termination. In other words, in the exemplary diagram of 
Fig. 3, only steps 300-306 would be continually executed 
until a termination condition is met (step 301) . 

However, if the execution system fails to identify 
which procedure step should be executed next (negative 
determination in step 302), or fails to generalize (negative 
determination in step 303), then the system temporarily 
relinquishes the procedure execution to the user for manual 
execution, whereby the process flow continues from step 308. 

More specifically, there may be unforeseen conditions 
that occur, in which the execution engine is unable to 
determine the next step of the procedure to be executed 
(negative determination in step 302) . For instance, the 
previous action may have resulted in an error condition for 
which no recovery procedure had been recorded. 
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Moreover, there may be circumstances in which the 
execution engine is unable to generalize (negative 
determination in step 303) . For example, assume that the 
execution engine determines that it must launch a specific 
application. The execution engine will look for the 
application in a set of directories learned from the 
execution traces used for learning the procedure. Presuming 
that the application has been installed in an unusual 
directory and that the engine is not able to find the 
application, then the execution engine fails to generalize. 

When the system temporarily relinquishes the procedure 
execution to the user, the execution system starts recording 
system parameters, user actions, and system reactions (step 
308) that have been monitored starting from step 300. As 
the user executes actions, the execution system obtains 
recorded action (s) (step 309) and attempts, in real-time, to 
align the user actions with the procedure (step 310) . 

If the execution system determines that the current 
user action (s) cannot be aligned with the procedure 
(negative determination in step 310), the system will 
continue to obtain recorded user actions (step 309) and 
attempt alignment (step 311) . As the process of real-time 
alignment of user actions with the procedure continuously 
fails, the execution system will continue to record the user 
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generally be shortened/reduced (as compared to conventional 
methods), because the execution system could regain control 
of the procedure execution after the sub-procedure 
terminates, and then automatically execute known (learned) 

5 actions. Moreover, an updated, executable procedure can be 
reused by other users. Therefore, the number and length of 
calls to the service center to solve the same problem is 
substantially reduced using the systems and methods 
described herein. 

10 Moreover, as the computing environment evolves and new 

software or hardware components become available, a learned 
executable procedure is not rendered obsolete. For example, 
when a user having a computer with more recent components 
attempts to execute a given executable procedure, the 

15 execution engine may detect an unusual situation (steps 302 
or 303, Fig. 3) during execution of the executable 
procedure. In such circumstances, the user can enter a new 
portion of the executable procedure either with or without 
the assistance of the support center, whereby the executable 

20 procedure can be updated and made available to future users. 

Fig. 4 is a flow diagram of a method for executing an 
executable procedure according to another embodiment of the 
invention. Fig. 4 illustrates a mode of operation of a 
procedure execution engine (211, Fig. 2) according to 

25 another embodiment of the invention. In general, the method 
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of Fig. 4 is similar to the method of Fig. 3, but extends 
such method by enabling execution of a learned procedure 
under direct supervision of the user. 

More specifically, referring now to Fig. 4, a user will 
5 obtain/select/retrieve an executable procedure, and the 
execution engine will commence execution of the selected 
procedure while monitoring system parameters, user actions 
and system reactions (step 400) . Execution of the procedure 
will continue until a termination condition is met 

10 (affirmative determination in step 401) in which case the 
execution engine terminates execution (step 407) . It is to 
be understood that steps 400, 401 and 406 are essentially 
the same as steps 300, 301 and 307, respectively, of Fig. 3. 
On the other hand, when a termination condition is not 

15 met (negative determination in step 401) , the execution 
engine will attempt to determine if the next step of the 
executable procedure can be performed (step 402) . In one 
embodiment of the invention, this process (step 402) 
includes identifying the next step of the procedure that is 

20 to be performed and attempting to generalize the action (s) 
associated with the next procedure step. In other words, in 
one embodiment, step 402 is essentially the same as steps 
302 and 303 of Fig. 3 combined. 

If the next step of the procedure can be performed 
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(affirmative determination in step 402), the execution 
engine will demonstrate (or otherwise indicate) to the user 
the next action to be performed (step 403) . For example, in 
one embodiment where the execution system supports a GUI, 

5 the execution engine can interact with GUI widgets, for 
example, windows, menus, and buttons, to thereby indicate 
the next step of a procedure to the user by outlining, 
highlighting, or pointing to the window where the action is 
to be taken and textually explaining the action, for 

10 example, "select an item", "type the following sentence", 

"clicking the button", and displaying expert annotations, if 
available . 

The execution engine will then determine if the user 
has authorized the execution engine to perform such 

15 demonstrated/specified action (step 404). If the user 
authorizes the next step to be performed (affirmative 
determination in step 404), the specified action will be 
performed (step 405) . Otherwise, if authorization is not 
given (negative determination in step 404), the user can 

20 commence with manual execution (proceed to step 407) as 
explained above with reference to Fig. 3. 

It is to be appreciated that authorization from the 
user (step 404) can be obtained explicitly or implicitly. 
In one embodiment where explicit authorization is provided, 

25 the user interface can display a "next step" button, for 
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example, that enables the user to click or otherwise select 
the button to proceed with execution (step 405) . 
Furthermore, any user input required to perform the action 
(e.g., password) may be included in such authorization. 
5 On the other hand, the system can be configured such 

that the user can provide implicit direction to not execute 
the specified action, e.g., by the user performing another 
action, whereby execution proceeds to step 407. In yet 
another embodiment according to the present invention, the 

10 user interface can include a "pause" button, which 

temporarily pauses the procedure execution, thereby allowing 
the user to perform unrelated tasks in the interim. 

It is be appreciated that as with the method of Fig. 3 
explained above, the method of Fig. 4 allows a user to 

15 manually perform and record a portion of the executable 

procedure (in other words, steps 407, 408, 409, 410, 411 and 
413 of Fig. 4 are essentially the same as steps 308, 309, 
310, 311, 312, and 314, respectively, of Fig. 3). In 
addition, as with the method of Fig. 3, the method of Fig. 4 

20 allows incremental augmentation of the learned executable 
procedure from execution traces that are obtained during 
manual execution of a portion of an executable procedure 
(that is, steps 412 and 313 are essentially the same), even 
when no unforeseen events are detected and the next step of 

25 the procedure can be performed (affirmative determination in 
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step 402) . In other words, if an action can be performed 
and is demonstrated to the user, the user can still direct 
the system to not execute the action (negative result in 
step 404) and proceed manually (proceed to steps 408, et 
5 seq. ) . 

It is to be appreciated that the capability of allowing 
a user to manually perform a new sub-procedure or manually 
perform already learned steps of an executable procedure 
(according to the methods of Figs. 3 and 4) is not supported 

10 by conventional methods that use scripts. The methods and 
systems described herein support such capabilities because 
actions performed by the user are aligned with the learned 
procedure. When alignment is achieved, the execution engine 
can again take over the procedure and continue to correctly 

15 execute it. Conventional scripts or programs are not able 
to monitor user actions and recognize when they can resume 
operation. These functionalities must be programmed and 
tailored to individual procedures. 

It is to be further appreciated that in another 

20 embodiment of the invention, the method of Fig. 4 can be 

extended such that various steps in the process (e.g., steps 
402, 403, 404) are performed with other user interactions. 
For example, when implementing the method of Figure 4, when 
the execution system is faced with a situation where it is 

25 determined (in step 402) that multiple alternative actions 
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can be taken and the system cannot determine which action to 
select (negative determination in step 402), rather than 
proceed to step 407 , the system can be configured to inform 
the user that there are multiple possible actions, and 
5 demonstrate one or more possible actions to the user (step 
403) . For example, the system could list the actions 
textually, and allow the user to select which actions should 
be demonstrated. In this embodiment, the user would be 
allowed to select one of the multiple alternatives or to 

10 reject them all. 

In yet another embodiment, if the execution system is 
faced with multiple alternative actions, the system could be 
configured to rank such actions in the order of importance, 
display these actions in the ranked order, and provide the 

15 user with a justification of the ranking. For example, in a 
circumstance where most of the previously recorded traces 
perform a particular action, while a minority of the 
previously traces contain one or more different actions, the 
execution system could rank the particular action as the 

20 most important, and justify the ranking in terms of 

frequency of occurrence in previously recorded traces. 

It is to be appreciated that in addition to systems and 
methods for executing procedures learned from examples, 
other embodiments of the invention may be readily envisioned 

25 by those of ordinary skill in the art based on the teachings 
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herein. For example, in the system (200) depicted in Fig. 
2, the procedure generation module (207) in server (206) may 
comprise visualization and editing tools that would enable 
an expert to visualize and edit an executable procedure. A 
visualization tool preferably comprises those mechanisms 
described above (e.g., GUI simulation of procedure 
execution) . A procedure editing tool preferably enables, 
for example, adding and removing procedure steps or sub- 
procedures, adding and removing conditions that distinguish 
between sub-procedures, adding and removing annotations, or 
merging different procedure steps or sub-procedures. 

In another embodiment of the invention, some of the 
stored procedures (209) in the procedure server (208) can be 
directly constructed using a procedure editor tool, which 
allows an expert to construct procedures by demonstrating or 
coding individual steps, specifying preconditions and post- 
conditions of individual steps by demonstration or by manual 
coding, and combining multiple individual steps using the 
editing capabilities described above. 

Although illustrative embodiments have been described 
herein with reference to the accompanying drawings, it is to 
be understood that the invention is not limited to the 
precise system and method embodiments described herein, and 
that various other changes and modifications may be affected 
therein by one or ordinary skill in the art without 
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departing form the scope or spirit of the invention. All 
such changes and modifications are intended to be included 
within the scope of the invention as defined by the appended 
claims . 
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